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ABSTRACT 

This report presents an evaluation of the 
International Academy for Bilingual Education and Bicultural Studies, 
an Elementary and Secondary Education Act Title Vll-funded project in 
its third year of operation in 1992-93. The program provided 
instructional and support services to 74 Chinese- and 
English-speaking students in 1 pre-kindergarten, 1 kindergarten, and 
1 first-grade class at P.S. 1 in Community School District 2 in 
Manhattan, New York. The project offered a challenging curriculum 
designed to develop both groups' proficiency in English and Chinese, 
providing the participants with a program of bilingual education that 
used language development and enrichment activities within a 
framework of whole language methodology as well as cooperative 
learning. The project encouraged parent involvement and provided 
staff development workshops. An evaluation of the project found that 
it met all its pre-kindergarten objectives for social and academic 
development, content areas, arts, health and physical education, and 
multicultural awareness. The project met its objectives for English 
as a Second Language, Chinese language arts, staff development, and 
parental involvement. The project did not meet its dual language 
objectives for kindergarten or first grade. Three appendixes provide 
copies of the student checklist, staff questionnaire, and data 
collection and evaluation system. (MDM) 
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EXECUTIVE SUMMARY 



The International Academy for Bilingual Education and Bicultural Studies was 
an Elementary and Secondary Education Act (E.S.E.A.) Title Vll-funded project in its 
third year in 1 992-93. The program provided instructional and support services to 74 
Chinese- and English-speaking students in one pre-kindergarten, one kindergarten, 
and one first grade class at P.S. 1 in Community School District (C.S.D.) 2 in 
Manhattan. Thirty-three students (45 percent) were English proficient (EP) ( and 41 
(55 percent) were limited English proficient (LEP). The project offered a challenging 
curriculum designed to develop both groups' proficiency in English and Chinese. 
The project provided participants with a program of bilingual education, using 
language development and enrichment activities within the framework of whole 
language methodology as well as cooperative learning. 

Parents played an important role in their children's education and were present 
in the classroom throughout the year. Project staff attended various workshops. 

The project met all its pre-kindergarten objectives for social and academic 
development, content areas, arts, health and physical education, and multicultural 
awareness. The project met its objectives for English as a second language (E.S.L), 
Chinese language arts, improvement in native and second language literacy, staff 
development and parental involvement. The project did not meet its dual language 
objectives for kindergarten or first grade. The objectives for second language oral 
proficiency and reading could not be measured, since the proposed test was not 
administered. 

Based on the findings of this evaluation, the following recommendations are 
made to the project: 

• Examine the reasons why students did not achieve dual language 
proficiency. Adjust the criterion score on the checklist to reflect 
students' progress realistically. 

• Ensure that the testing instruments called for in the objectives are 
actually used. 
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I. INTRODUCTION 



This report documents the Office of Research, Evaluation, and Assessment's 
(OREA's) 1992-93 evaluation of the International Academy for Bilingual Education and 
Bicultural Studies. The project was in its third year of funding by Title VII of the 
Elementary and Secondary Education Act (E.S.E.A.). The project offered a 
challenging curriculum designed to improve the language proficiency of Chinese- 
speaking limited English proficient (LEP) and English proficient (EP) students. 

PROJECT CONTEXT 

The program operated at P S. 1 in Community School District (C.S.D.) 2 in 
Manhattan. The student population in C.S.D. 2 was 33.8 percent Asian-American, 
29.1 percent European-American, 22.4 percent Latino, 14.4 percent African-American, 
and 0.3 percent Native American. Eighteen percent of the students in the district 
were LEP, and 54 percent were from low-income families and were eligible for the 
federally funded free-lunch program. 

Of the 628 students who attended P.S. 1 during the 1992-1993 year, 70 percent 
were Asian-American, 16 percent were Latino, 13 percent were African-American, and 
one percent were European-American. Thirty-one percent were LEP, and 89 percent 
came from low-income families. 

STUDENT CHARACTERISTICS 

The International Academy for Bilingual Education and Bicultural Studies served 
74 students in pre-kindergarten, kindergarten, and first grade. Male students 
numbered 35 (47 percent), and females numbered 39 (53 percent). The project used 
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a home language survey as well as input from parents and teachers to determine if 
students were LEP or EP. 
Needs Assessment 

Prior to establishing this program, C.S.D. 2 carried out a needs assessment 
survey of the targeted LEP and EP student population, their families, and the staff 
who were to serve them. Over 100 families were interviewed prior to the first year of 
programming. It was determined that parents of both LEP and EP students wanted a 
challenging curriculum offered to their children that would teach them to use 
language effectively. 



PROJECT OBJECTIVES 
Student Objectives 



• At least 90 percent of participating pre-kindergarten children will improve 
their adjustment to the school environment; development of interpersonal 
relationships (with peers and adults); memory, thinking, and reasoning skills; 
use of materials; and speaking and listening skills, as measured by teacher 
logs, checklists, and monthly reports. 

• At least 90 percent of participating pre-kindergarten children will make 
appropriate progress in each of the following areas: arts, communication 
arts, health education, mathematics, music, physical education, science, and 
social studies, as measured by teacher logs, checklists, and monthly 
reports. 

• At least 50 percent of participating pre-kindergarten children will 
demonstrate a level of reading-related skills equal to or greater than that of 
their non-LEP classmates, as measured by end-of-year teacher-developed 
assessment procedures. 
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• At least 50 percent of participating pre-kindergarten children will 
demonstrate a level of mathematics and problem solving-related skills equal 
to or greater than that of their non-LEP classmates, as measured by end-of- 
year teacher-developed assessment procedures. 

• At least 90 percent of participating pre-kindergarten children will improve 
their ability to develop their thinking skills, solve problems, and do creative 
work, as measured by teacher logs, checklists, monthly reports, and Student 
Product Assessment Forms. 

• At least 90 percent of participating pre-kindergarten students will improve 
their knowledge of and attitudes toward their own and others cultures, as 
measured by classroom instruments and teacher observations. 

• At least 90 percent of students who have been in the program for two years 
will attain dual language proficiency. 

• At least 80 percent of the students (first grade) who have been in the 
program for three years will have attained dual language proficiency. 

• At least 90 percent of students who have been in the program for two years 
will demonstrate improved native and second language literacy. 

• At least 85 percent of the students (first grade) studying Chinese for three 
years will have improved their level of Chinese language skills, as 
demonstrated by a significant increase in scores on a staff-developed 
Chinese Language Arts Test, measured by a correlated f-test for significance 
of difference between pre- and posttest scores. 

• At least 80 percent of the participating students studying Chinese will have 
improved their level of Chinese language skills as demonstrated by a 
significant increase in scores on a staff-developed Chinese Language Arts 
Test, measured by a correlated t-test for significance of difference between 
pre* and posttest scores. 

• At least 75 percent of the students participating for at least two years will 
significantly improve their second language oral proficiency, as measured by 
a pre/post comparison of language complexity scores on the English and 
Chinese versions of the Basic Inventory of Natural Language (BUNGHOLE). 

• At least 80 percent of the students (first grade) who have completed the 
Reading Recovery Program will test at or above grade level on the citywide 
reading test (CAT). 
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• Participating LEP students will show improvement on the English language 
version of the Language Assessment Battery (LAB) greater than that of a 
non-project comparison group. 

• Participating students will improve their English language skills as 
demonstrated by a significant increase in scores on the LAB as measured 
by a correlated t-test for significance between pre- and post-test scores 
converted into Normal Curve Equivalent (N.C.E.) units. 

Staff Development Objectives 

• At least 80 percent of participating teachers and paraprofessionals will 
demonstrate an increased knowledge of project content and methodology, 
as measured by pre- and posttraining questionnaires. 

• At least 80 percent of participating teachers and paraprofessionals will 
improve their ability to use project content and methodology in a bicultural, 
bilingual educational setting, as measured by pre- and post-questionnaires 
and by structured classroom observations by the Project Director and an 
independent evaluator. 

• The staff of the International Academy (teachers and paraprofessionals) will 
find satisfactory for use with their International Academy students project- 
adapted and developed curricula, as measured by a questionnaire. 

Parental Involvement Objectiv es 

• A minimum of 60 percent of parents of participating International Academy 
students will have participated in a minimum of three parent activities as 
measured by attendance records for parental involvement activities. 

• At least 60 percent of the parents of participating students will have 
demonstrated a satisfactory level of understanding of and participation in 
their children's education, as measured by a parent checklist in English and 
Chinese, and by teachers' reports. 



PROJECT IMPLEMENTATION 

In 1992-93, its third year of service, the program provided instructional and 
support services to 74 Cantonese and English-speaking students in one pre- 
kindergarten, one kindergarten, and one first-grade class at P.S. 1. There were 18 
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pre-kindergarten, 29 kindergarten, and 27 first-grade students. Of these, 33 (45 
percent) were EP, and 41 (55 percent) were LEP. 

The emphasis of the project was on providing LEP and EP students with an 
enriched program of bilingual education, using language development and activities 
within the framework of a whole language methodology. The International Academy 
for Bilingual Education and Bicultural Studies was based on the theory that LEP 
students benefit most from approaches which emphasize their strengths — native 
language ability end knowledge of their own culture— rather than their lack of 
proficiency in English, while EP students had the opportunity to learn Cantonese as a 
second language. Staff development and parental involvement activities were an 
integral part of programming and were well attended. 

The project originally intended to provide extended-day (8 a.m. to 6 p.m.) 
instruction to all students, but the cost was prohibitive. Instead, the program ran from 
8:45 a.m. until 3:00 p.m. 
Materials. Methods, and Techniques 

Classroom teachers used storybooks written in both Chinese and English and a 
variety of hands-on activities that included dolls, blocks, and manipulatives. The 
whole language approach was emphasized by the project. Cooperative learning 
techniques as well as learning centers were also used. 




Staff Qualifications 

Title VII staff. Title Vll-funded staff included two paraprofessionals, a staff 
developer, and a community liaison. For a description of degrees held, language 
proficiency (teaching or communicative*), and years of experience, see Table 1. 

TABLE 1 



Project Staff Qualifications 



Title 


Degree(s) 


Chinese Language 
Proficiency 


Years of 
Experience 


Staff Developer/ 
Project Director 


B.A. 


TP 


7-10 


Paraprofessional 


High School 


N.S.' 


1-3 


Paraprofessional 


High School 


N.S. 


N.A. 


Community Liaison 


High School 


CP 


N.A. 



*N.S.= Native speaker. 



Other staff. Tax-levy funds paid the salaries of nine teachers and one 
paraprofessional. All teachers were certified in the areas in which they taught. For a 
description of degrees held, language proficiency, and experience, see Table 2. 

Staff development . All project staff attended workshops throughout the year. 
Topics included conflict resolution, teaching with computers, and problem solving in 
mathematics. 

♦Teaching proficiency (TP) is defined as the ability to use LEP students' native 
language in teaching language arts or other academic subjects. Communicative 
proficiency (CP) is defined as a non-native speaker's basic ability to communicate 
and interact with students in their native language. 
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TABLE 2 
Qualifications of Non-Title VII Staff 



Title 


Degree(s) 


Certification 


Chinese 
Language 
Proficiency 


Years of 
Experience 


9 Teachers 

1 Paraprofessional 


6 M.A. 
4 B.A. 


9 Teaching 
(Elementary 
Education) 


4 N.S.* (TP) 
2 TP 
2 CP 


11+ (2) 
7 0) 



*N.S.- Native speaker. 



Length of Time Participants Received Instruction 

Students had a median of 2.3 years of education in the United States. 
PARENT AND COMMUNITY INVOLVEMENT ACTIVITIES 

Parents played an important role in their children's education. At the pre- 
kindergarten level, the school provided breakfast for parents and children in the 
classroom. There was a strong Parent Advisory Council (PAC) at P.S. 1 . 

On a parental needs assessment earned out at the beginning of the school year, 
parents were encouraged to indicate the activities and meetings ihey would like 
offered. Based on this input, parents' workshops covered topics such as child 
development, and Chinese and African cultures. Workshops were also offered by the 
New York Telephone Company, the Arts Connection, and New York University's 
School of Dentistry. Project students' parents attended open-school meetings 
throughout the year. 
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li. EVALUATION METHODOLOGY 

EVALUATION DESIGN 

Project Group's Educational Progress as Compared to That of an Appropriate Non- 
Proiect Group 

OREA used a gap reduction design to evaluate the effect of dual language 
instruction on kindergarten and first grade students' performance on standardized 
tests. Because of the difficulty in finding a valid comparison group, OREA used the 
groups on which the tests were normed. Test scores are reported in Normal Curve 
Equivalents (N.C.E.s), which are normalized standard scores with a mean of 50 and a 
standard deviation of 21.1. It is assumed that the norm group has a zero gain In 
N.C.E.s in the absence of supplementary instruction and that participating students' 
gains are attributable to project services. 
Applicability of Conclusions to All Persons Served bv Project 

Data were collected from all participating students for whom there were pre- and 
posttest scores. {There were no pretest data on students who entered the program 
late; therefore, posttest data for them will serve as pretest data for the following year.) 
Instruments used to measure educational progress were appropriate for the students 
involved. The LAB is used throughout New York City to assess the growth of English 
skills in populations similar to those served by the International Academy for Bilingual 
Education and Bilingual Studies Project. 
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INSTRUMENTS OF MEASUREMENT 

Because of the age of the pre-kindergarten children, no formal tests were 
administered to them, and data were based on teacher observations. For 
kindergarten and first grade children, pre- and posttest scores on the LAB were 
assessed by OREA. 

All students were tested at the appropriate- grade level. The language of the 
LAB was determined by the test itself. 

According to the publishers' test manual, the LAB is valid and reliable. Evidence 
supporting both content and construct validity is available for the LAB. Content 
validity is confirmed by an item-objective match and includes grade-by-grade item 
difficulties, correlations between subtests, and the relationship between the 
performance of students who are native speakers of English and students who are 
LEP. To support reliability, the Kuder-Richardson Formula 20 (KR20) coefficients and 
standard errors of measurement (SEM) are reported by grade and by form for each 
subtest and total test. Grade reliability coefficients, based on the performance of LEP 
students on the English version, ranged from .88 to .96 for individual subtests and 
from .95 to .98 for the total test. 

Project staff developed a checklist to examine English- and Chinese-language 
skills. (See Appendix A.) 

To assess the staff development objectives regarding knowledge and use of 
project content and methodology, OREA developed and analyzed the results of a 
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questionnaire. (See Appendix B.) To assess the staff development objective for staff 
satisfaction with curriculum, an OREA consultant interviewed the project director. 

To assess the parental involvement objectives for activities and meetings, the 
project director provided attendance rates. To assess the objective for parental 
understanding and participation, an OREA consultant interviewed the project director. 

DATA COLLECTION AND ANALYSIS 
Data Collection 

In order to collect data, the evaluation consultant made visits to the school site 
to observe classes and interview the project director and staff. Correspondence 
between OREA and project personnel was maintained over the course of the school 
year. The project director collected data throughout the year and prepared it in 
accordance with the Data Collection and Evaluation System provided by the Office of 
Bilingual Education and Minority Language Affairs (OBEMLA). OREA received and 
analyzed the data in order to complete the evaluation process. 
Proper administration of instruments 

Qualified personnel received training in testing procedures and administered the 
tests. Test administrators followed guidelines set forth in the manuals accompanying 
standardized tests. Time limits for subtests were adhered to; directions were given 
exactly as presented in the manual. 
Testing at twelve-month intervals 

Standardized tests were given at 12-month intervals, following published 
norming dates. 
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Data Analysis 

Accurate scoring and transcription of results . Scoring, score conversions, and 
data processing were accomplished electronically by the Scan Center of the Board of 
Education of the City of New York. Data provided by the Scan Center were analyzed 
in the Bilingual, Multicultural, and Early Childhood Evaluation Unit of OREA. Data 
collectors, processors, and analysts were unbiased and had no vested interest in the 
success of the project. 

Use of analyses and reporting procedures appropriate for obtained data . To 
assess the significance of students' achievement in English, OREA computed a 
correlated f-test on LAB N.C.E. scores. The f-test determined whether the difference 
between the pre- and posttest scores was significantly greater than would be 
expected from chance variation alone. 

The only possible threat to the validity of the above instrument might be that 
LAB norms were based on the performance of EP rather than LEP students. Since 
OREA was examining gains, however, this threat was inconsequential— the choice of 
norming groups should not affect the existence of gains. 
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III. FINDINGS 



PARTICIPANTS' EDUCATIONAL PROGRESS 

The International Academy for Bilingual Education and Bicultural Studies carried 
out the instructional activities specified in its original design. Students were able to 
develop their native and second languages as they covered basic curricula. All 
instruction was in both English and Chinese. Project teachers used a whole 
language approach, in both the native and the second language, as well as 
cooperative learning techniques. 

LEP and EP Participants' Progress in Native and Second Languages 

An OREA consultant observed a pre-kindergarten project class. Students sang 
about the days of the week, and one child went before the class and drew a sun on 
the calendar to represent the day's weather. The class took attendance by counting. 
The teacher then put the attendance on an experience chart in English and translated 
it into Chinese, after which the children sang a song in both English and Chinese. 
Students were assigned at random to engage in activities in the learning centers for 
housekeeping, water play, block play, painting, listening, reading, and cooking. 

The classroom was beautifully decorated with children's work. There was a 
bulletin board with a display of students' art and names written in Chinese and 
English. 

The OREA consultant also observed a kindergarten class. The classroom was 
very large and nicely decorated. The children discussed the weather and the teacher 
wrote in English and Chinese on the experience chart, "Today is a sunny day." The 
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children read the sentence aloud in both languages. The teacher displayed a 
calendar, and the children counted the days backward and forward in English and 
Chinese. The class then began another activity in which they worked on the letter G. 
They wrote the words "green" and "gold" in English and Chinese and drew pictures 
using those colors. 

A first grade class observed by the OREA consultant was also very nicely 
decorated with children's work. Drawings were labeled in English and Chinese. 
Learning centers in the classroom included reading, writing, art, numbers, and an 
"Authors' Corner," where books created by students were displayed. 

The class had attended a performance given by the higher grades about the 
Great Wall of China, and the teacher discussed the play and elicited students' 
opinions of it. The students then engaged in a writing activity, working on a picture 
book they were creating. 
Programming at Pre-Kinderaarten Level 

The project proposed the following objectives for pre-kindergarten: 

• At least 90 percent of participating pre-kindergarten children will improve 
their adjustment to the school environment; development of interpersonal 
relationships (with peers and adults); memory, thinking, and reasoning skills; 
use of materials; and speaking and listening skills, as measured by teacher 
logs, checklists, and monthly reports. 

At the beginning of the school year, small groups of children attended classes 

on a staggered basis in order to ease their adjustment to school. Throughout the 

year, parents joined their children for breakfast in the classroom and stayed for part 
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of the day. As their children's independence increased, the parents spent less time 
in the classroom. 

in order to help children develop interpersonal relationships, project staff used 
learning centers, and role-playing with puppets and other theatricals to reenact 
situations with peers and adults. 

In order to foster memory, thinking, and reasoning skills, students were 
encouraged to verbalize their experiences. They also used manipulative toys and 
sang. After going on a trip, children spoke about what they saw, and the teacher 
wrote it on an experience chart. 

The classrooms had discrete learning centers, including centers for science, 
sand and water play, household chores, blocks, reading, audio, cooking, and arts 
and crafts. Each class also had a menagerie with many kinds of animals, including 
fish, frogs, turtles, snails, crabs, and insects. 

In order to reinforce listening and speaking skills, every morning the children 
discussed their experiences, the weather, holidays, and current events. Students 
shared stories, books, games, and songs with each other. In each area of social and 
academic development, all the students made progress. 

The project met its social/academic development objective. 
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© At least 90 percent of participating pre-kindergarten children will make 
appropriate progress in each of the following areas: arts, communication 
arts, health education, mathematics, music, physical education, science, and 
social studies, as measured by teacher logs, checklists, and monthly 
reports. 

Art was an important part of the day for project participants. Students painted, 
modeled clay and Play Dough, cut and folded paper, and made collages. The 
children's work was prominently displayed around the classroom. 

In order to enhance learning in communication arts, the class used storyboards, 
from which the children read, wrote, and told each other stories. 

In health education, students and teachers discussed personal hygiene, 
nutrition, and environmental issues. 

All children learned to count in both English and Chinese. Cuisinaire rods and 
other manipulatives were used to foster skills in mathematics. When discussing 
birthdays, age, the calendar, and attendance, mathematical concepts were 
addressed. Students estimated the weight of objects and used a balance scale for 
actual measurement. 

Music was played in the classroom throughout the day and was an important 
part of the learning process. Students sang, danced, and marched to the music. 
The teacher played a keyboard, and children had rhythm instruments. 

Students engaged in physical education daily in the indoor gym or the 
schoolyard. They performed gymnastics, played with hula hoops and bean bags, 
and participated in other group activities. 
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Science topics were discussed as children used the sand and water centers. 
Science activities also included caring for the classrooms' many animals, planting 
seeds, and making observations of the plants as they grew. 

Children learned about the community while taking walks around the 
neighborhood. The class made a map of where the children lived and looked for 
classmate's residences as they walked. Participants visited the New York Aquarium, 
the Children's Zoo in Central Park, and a farm. Chinese and American cultures were 
discussed at every opportunity and were used as themes for art created by the 
children. 

In each area covered by the objective, all of the students made progress. 
The project met the objective for progress in content areas, arts, health 
education, and physical education. 

• At least 50 percent of participating pre-kindergarten children will 

demonstrate a level of reading-related skills equal to or greater than that of 
their non-LEP classmates, as measured by end-of-year teacher-developed 
assessment procedures. 

Objects in the classrooms were labeled in both English and Chinese. Students 
would retell stories after project staff read to them. Virtually all students recognized 
the letters of the alphabet and, in some cases, the sounds of the letters. The children 
were able to identify their own as well as other children's names. By the end of the 
year, most were able to write their own name. 

The project met the objective for demonstration of reading-related skills. 
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• At least 50 percent of participating pre-kindergarten children will 
demonstrate a level of mathematics and problem solving-related skills equal 
to or greater than that of their non-LEP classmates, as measured by end-of- 
year teacher-developed assessment procedures. 

• At least 90 percent of participating pre-kindergarten children will improve 
their ability to develop their thinking skills, solve problems, and do creative 
work, as measured by teacher logs, checklists, monthly reports, and Student 
Product Assessment Forms. 

At the conclusion of the school year, most students could recognize numerals 
and were able to count to ten. and some could count to 20. Problem-solving and 
thinking skills were taught through a variety of activities, including cooking and 
building with blocks and LEGOS. 

The project met its objectives for demonstration of mathematics and problem- 
solving and thinking skills. 

• At least 90 percent of participating pre-kindergarten students will improve 
their knowledge of and attitudes toward their own and other cultures, as 
measured by classroom instruments and teacher observations. 

Project students celebrated various ethnic holidays throughout the year. Stories 
and poems from different cultures were integrated into the curriculum. Parents were 
present in the classroom on a regular basis and provided insight into different 
cultures. Assemblies were held at which students learned African stories and songs 
and Chinese dance movements. 

The project director reported that all of the students made progress in cultural 
awareness. 

The project met the objective for increased cultural awareness. 
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Programming at Kindergarten and First Grade Levels 

The project proposed the following objectives for students in kindergarten and 
first grade: 

• At least 90 percent of students who have been in the program for two years 
will attain dual language proficiency. 

At the kindergarten level, dual language proficiency was defined as obtaining a 

score of 18 in both Chinese and English on the project-developed checklist. Eighty 

percent of the kindergarten students were found to be dual-language proficient. 

The project, therefore, did not meet its dual language objective for kindergarten. 

The criterion for dual language proficiency may have been unrealistic and should be 

reexamined. 

• At least 80 percent of the students (first grade) who have been in the 
program for three years will have attained dual language proficiency. 

For these children, dual language proficiency was defined as obtaining a score 
of 24 in both Chinese and English at the first grade level. Seventy-one percent of first 
grade students were found to be dual-language proficient according to this criterion. 

The project did not meet its objective for first grade dual language proficiency. 
The criterion for dual language proficiency may be unrealistic and should be 
reexamined. 
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• At least 90 percent of students who have been in the program for two years 
will demonstrate improved native and second language literacy. 

Twenty-four students had been in the project for at least two years. Of these 
students, 96 percent achieved perfect scores or showed Improvement on the student 
checklist for native and second language literacy. 

The project met its objective for improvement in native and second language 
literacy. 



• At least 85 percent of the students (first grade) studying Chinese for three 
years will have improved their level of Chinese language skills, as 
demonstrated by a significant increase in scores on a staff-developed 
Chinese Language Arts Test, measured by a correlated f-test for significance 
of difference between pre- and posttest scores. 

Five LEP first grade students had been in the project for three years. All of them 

showed improvement on the Chinese language skills section of the project-developed 

checklist. 

The project met its objective for Chinese language skills in first grade. 



• At least 80 percent of the participating students studying Chinese will have 
improved their level of Chinese language skills as demonstrated by a 
significant increase in scores on a staff-developed Chinese Language Arts 
Test, measured by a correlated t-test for significance of difference between 
pre- and posttest scores. 

Eleven EP students had been in the project for at least two years. OREA used 
the Chinese language skills section of the checklist to measure their progress. One 
hundred percent of these students showed improvement in this area. 

The project met its objective for increase of Chinese language skills. 
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• At least 75 percent of students participating for at least two years will 
significantly improve their second language oral proficiency, as measured by 
a pre/post comparison of language complexity scores on the English and 
Chinese versions of the Basic Inventory of Natural Language (BINL). 

The BINL was not given, therefore OREA could not measure this objective as 

stated. However, OREA examined the students' scores from the Chinese and English 

Expressive Language and Articulation sections of the checklist. Of the 1 1 EP 

students and 13 LEP students who had been in the project for at least two years, 100 

percent improved, or maintained already perfect scores for this section of the 

checklist. 

Although OREA could not measure this objective as stated, it should be noted 
that students showed improvement in Chinese and English expressive language and 
articulation according to the project-developed checklist. 

• Participating LEP students will show improvement on the English language 
version of the LAB greater than that of a non-project comparison group. 

• Participating students will improve their English language skills as 
demonstrated by a significant increase in scores on the LAB as measured 
by a correlated f-test for significance between pre- and post-test scores 
converted into Normal Curve Equivalent (N.C.E.) units. 

Eighteen students took both the pre- and posttest of the LAB. They showed a 

mean gain of 17.44 N.C.E.s (s.d.= 17.4), which was statistically significant (f=4.25, 

p<.05). 

The project met both its objectives for E.S.L. 
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• At least 80 percent of the students (first grade) who have completed the 
Reading Recovery Program will test at or above grade level on the citywide 
reac ng test (CAT). 

The Degrees of Reading Power (D.R.P.) test is currently used in New York City 
to assess reading skills. However, neither the D.R.P. nor the CAT in reading are 
given until second grade, therefore this objective is not measurable as stated. 

OVERALL EDUCATIONAL PROGRESS ACHIEVED THOROUGH PROJECT 
Mainstreaminq 

By definition, a developmental bilingual education program such as this one 
does not have mainstreaming; participating students remain in the program for its 
duration. 
Attendance 

The International Academy for Bilingual Education and Bicultura) Studies did 
not propose any objectives for attendance. Project students had an 85 percent 
attendance rate, as compared to a 93 percent mainstream rate. 

STAFF DEVELOPMENT OUTCOMES 

• At least 80 percent of participating teachers and paraprofessionals will 
demonstrate an increased knowledge of project content and methodology, 
as measured by pre- and post-training questionnaires. 

• At least 80 percent of participating teachers and paraprofessionals will 
improve their ability to use project content and methodology in a bicultural, 
bilingual educational setting, as measured by pre- and post-questionnaires 
and by structured classroom observations by the Project Director and an 
independent evaluator. 
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According to the questionnaires developed and distributed by OREA, 100 
percent of participating staff increased their knowledge of project content and 
methodology and improved their abilities in these areas. 

The project met its staff development objectives for knowledge of project content 
and methodology and improvement of abilities. 

• The staff of the International Academy (teachers and paraprofessionais) will 
find satisfactory for use with their International Academy students project 
adapted and developed curricula as measured by a questionnaire. 

The project director indicated that staff were committed to the concept of dual 

language instruction and were satisfied with the curricula provided by the project. 

The project met its objective for staff satisfaction with curricula. 

PARENTAL INVOLVEMENT OUTCOMES 

• A minimum of 60 percent of parents of participating International Academy 
students will have participated in a minimum of three parent activities as 
measured by attendance records for parental involvement activities. 

Ninety percent of parents participated in a Chinese New Year celebration, 60 
percent participated in an Easter egg hunt, and 85 percent participated in Chinese 
and African cultural activities. 

Parents also attended meetings throughout the year. These meetings included 
those of the PAC and P.T.A., an open-school meeting, parental conferences, and 
child development discussions. The New York Telephone Company and N.Y.U. 
Dental School also offered meetings outlining their services. 

The project met its objectives for parental participation in activities. 
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• At least 60 percent of the parents of participating students will have 
demonstrated a satisfactory level of understanding of and participation in 
their children's education, as measured by a parent checklist in English and 
Chinese, and by teachers' reports. 

The project director reported that parents demonstrated a satisfactory level of 

understanding and participation in their children's education. 

The project met its objective for parental understanding and participation. 
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IV. SUMMARY, CONCLUSIONS, AND RECOMMENDATIONS 



ACHIEVEMENT OF OBJECTIVES 

The International Academy for Bilingual Education and Bicultural Studies met all 
its pre-kindergarten objectives for social and academic development, content areas, 
arts, health education, physical education, and multicultural awareness. For 
kindergarten and first grade, the project did not meet its dual language objectives but 
met its objectives for E.S.L (using the LAB), and for Chinese language arts, and 
improvement in native and second language literacy. The objectives for second 
language oral proficiency and reading could not be measured as they were stated. 
The project met its objectives for staff development and parental involvement. 

MOST AND LEAST EFFECTIVE COMPONENTS 

The International Academy for Bilingual Education and Bicultural Studies was 
successful in providing students with a nurturing environment for facilitating the 
achievement of English for LEP students and Chinese for EP students. Staff and 
parental components were well received. 

The International Academy for Bilingual Education and Bicultural Studies 
benefited students academically and also increased their awareness of their own and 
other cultures. Teachers of participating students improved their teaching techniques 
by attending various workshops. Parents of participating students also benefiisd 
from the program by participating in activities. 
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RECOMMENDATIONS TO ENHANCE PROJECT EFFECTIVENESS 

Based on the findings of this evaluation, the following recommendations are 
made to the project: 

• Examine the reasons why students did not achieve dual language 
proficiency. Adjust the criterion score on the checklist reflect students' 
progress realistically. 

• Ensure that the testing instruments called for in the objectives are actually 
used. 
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Stuaent Checklist 



INTRANATIONAL ACADEMY 
STtlRBNT CH ECKLIST THROUOH 3) 



CmH KAMI- t lUnrr CI AM: 

o ati or itiTM not 

lutro smash or: _ oat t or cactutr. 



1 CCCgPTlVg LANGUAGE 1CH1NESE1 ItMfiUSHl 

raiov$$mct«cr<m o* ot 02 01 

SUtTOTAl: RECEPTIVE LANCUA6E (ENGLISH) • 

SUtTOTAl: RECEPTIVE LANGUAGE (CHINESE) • 

7 f yppcsswf I AMfiUAfig A ND iAPTiculation lEMfiUSHl 

SttAKSCUARLV % jj* •) 

EXPRESSES THOUGHTS UNDERSTANDABLY « 01 

u$E$ SIMPLE S£N7£NCES a! 

engages inccwewatjon ^thaoc.ts and/or peers 02 oi 

RET Ctt$ S» MPl E STORY i * * EOUEnCI 01 P 1 

REUUESANEXPERlE*C,faNT.OR$TORYINOWN WORDS 02 01 

SUtTOTAl: EXPRESSIVE LANGUAGE AND ARTICULATION (ENGLISH) « - 



3 rnCWlTtVr OPVn OPMgNT & LAMGUAGg SKILLS lENfiUSHl 
ASSOCIATES LETTERS Of TH£ ALPHABET WITH THEtR SOUNDS 02 01 
RECOGNIZES INITIAL SOUNDS A LETTERS IN WORDS 02 01 
RECOGNIZES f INAL SOUNDS * LETTERS IN WORDS 02 01 
USES INVENTIVE SPELLING 02 01 
RECOGNIZES LETTERS OF THE ALPHABET (UPPERCASE) 02 01 
RECOGNIZES LETTERS Of THE ALPHABET (LOWERCASE) 02 01 
WRITES UPPER CASE LETTERS 02 0! 
WfclTES LOWER CASE LETTERS 02 tl 
USES CONVENTIONAL SPELLING 02 01 
flNDS OWN TOPICS fOR WRITING 02 01 
WRITES SIMPLE STORIES W:TH MINIMAL ASSISTANCE f ROM ADULTS 02 01 

SUtTOTAl: COGNITIVE DEVELOPMENT A LANGUAGE SKILLS (ENGLISH) « 

4 EKPttCSSiV g LANGUAGE AND ARTICULATION L£MW£3£l 
SPEAKS CLEARLY 02 01 
EXPRESSES THOUGHTS UN0S3STAN0ASIY 02 01 
USES SIMPLE SENTENCES 02 01 
ENGAGES iN CONVERSATION .VlTH ADULTS AND/OR PEERS 02 01 
RETELLS SIMPLE STORY IN tEOUENCE 02 01 
RELATES AN EXPERlENCE.EVENT, OR STORY IN OWN WORDS 02 01 

SUtTOTAl: EXPRESSIVE LANGUAGE ANO ARTICULATION (CHINESE) • 



S COGNITIVE ftgVELOPMEIff t* 1 AMfiUAfig SKILLS (CHINESE. 

WRITES tASlC STROKES •* 

RECOGNIZES NUMERALS 02 01 

WRITES NUMERAL ( ) 02 01 

RECOGNIZES SIMPLE CHARACTERS 02 01 

WRITES SIMPLE CHARACTER! 02 01 

RECOGNIZES COMPLEX CHARACTERS 02 01 

WRITES COMPLEX CHARACTERS 02 01 



WRITES SENTENCES 2* 
riNOSOWNTOWCSfORWRlTlNO •« •) 

WRtTESSlMnESTORtESWTHMINimtASSISTANCErRCMAOUlTS 02 tl 

SUtTOTAl: COGNITIVE OEVELORHEITT A LANGUAGE SKILLS (CHINESE) • — 

MKmammii CH, " tM 

RECEPTIVE LANGUAGE ' • 

EXPRESSIVE LANGUAGE ANO ARTICULATION 1 ■ 

COGNITIVE OEVELORHENT ANO LANGUAGE SKILLS 



TOTALS: 
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APPENDIX B 
Staff Questionnaire 



BILINGUAL MULTICULTURAL, AND EARLY CHILDHOOD EVALUATION 

OFFICE OF RESEARCH, EVALUATION, AND ASSESSMENT 

NEW YORK CITY PUBLIC SCHOOLS 

110 LIVINGSTON STREET, ROOM 732 

BROOKLYN, NY 11201 

(718) 935-3790 FAX (718) 935-5490 



Otto* of Raaaaroh, Evaluation, and > 
For OurftftjraUttfttrt 



Oft*** MuMnMum, and UriyCMdhoorf 



STAFF DEVELOPMENT QUESTIONNAIRE 



917 

1 2 

Project: International Academy for Bilingual Education and Bicultural Studies 



Directions : Please write "V for Yes, "N" for No in the boxes at the right 



1. As a result of participating in the workshops given during the 1992-93 
school year, did you increase your knowledge of project content and 
methodology? 

□ 

3 



2. Did you improve your ability to use project content and methodology in 
a bicultural, bilingual educational setting? 

□ 

4 

THANK YOU. 
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APPENDIX C 
Data Collection and Evaluation System 
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Date Section Completed: 

SECTION 1 



PROJECT IDENTIFICATION DATA 



ER?C 



Section 1 contains descriptive information on this project. Please complete items 1-9. 

1. Grant number: T00 3do03 2^ 

2. Type of project (check one): 

Transitional Bilingual Education 

Special Alternative 

Developmental V 

Special Populations 



3. Years of project under this Title VII grant: 1 2@4 5 

4. Na.eCproiec,: X^-Wi KjgUj "tS^ 

5. School district: ^amnuuuVy d^d^oo\ I^tsVrra^ 2- 
Address: 

1>.S 1 M^n. 

£> .Wry SA-r^e-V Hit \2SJ>& 

6. Project director VA^/^dnVe. S»Vccu^s> 

7. Phone numben (24 1) 2^??- 4-1 

8. Title VII grant award to nearest dollar amount in current fiscal yean 

* 144,000— 



9. Amount of Title VII support expended for evaluation in current fiscal year: 



1-1 
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Date Section Completed: 

SECTION 2: DISTRICT AND SCHOOL INFORMATION 
Directions for Section 2-a: District Information. 

Section 2-a contains information on district demographics. The information requested in 
questions 1-4 is required by the Title VII legislation. 

1 . Number of all children enrolled in programs conducted by the LEA (i.e., total public school 
enrollment) [7021 (c)(2)(A)]: ^ 

Number of children 9 L ' £ 2 Lz 

Date data collected 

2. Number of limited English proficient (LEP) children enrolled in public and private schools 
in the district [7021 (c)(2)(C)(i)]: 

PUBLIC PRIVATE 

Number of LEP children 

Date data collected *// c /3 

3. Method used to determine the number of limited English proficient children enrolled in 
public and private schools [Leg. Sec. 7021 (c)(2)(C)(ii)]: 

PUBLIC: L.Prfb 

PRIVATE: 

4. The number of children who are receiving instruction through this Title VII project 
[7021(c)(2)(F)]: 

Limited English Proficient (LEP) 
Language Minority English Proficient (EP) 
English Language Background English 
Proficient (EP) 



33 



The information requested in questions 5-9 is not required by the Title Vil legislation but is 
recommended to provide an accurate picture of the project setting. 



5. 



Number of schools in district: % Y 



6. Type of geographic area (check all that apply): 

Rural 

Suburban 

Urban S 

7. Student racial/ethnic distribution in district (in percents): 

American Indian or Alaskan Native 

(e.g., Eskimo, Aleut) - £ 



Asian/Pacific Islander ^3 

Hispanic -93 

Black, other than Hispanic \H H 

White, other than Hispanic J 9. ) 

TOTAL 100% 

Date Data Collected 



8. Percent of distri .Jt K - 12 student population from low 
income families: 

Date data collected: 

Definition of low income (check all that apply): • , 

School lunch program 

Aid to Families with Dependent 

Children (AFDC) 

Other 

9. Number of student attendance days in 

current school year: 



I-3 
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Directions for Section 2-b: School Information. 

Section 2-b contains information on school demographics for those schools that participate in this Title 
VII project. This information should be provided to describe your project accurately. Please fill out a 
separate form for each school in your district with Title VII project students. 

1. School name: 

2. Type of geographic area: 

Rural 
Suburban 
Urban 

3. Number of children in the school: 

4. Student racial/ethnic distribution (in percents): 

American Indian or Alaskan Native (e.g., Eskimo, Aleut) 
Asian/Pacific Islander 
Hispanic 

Black, other than Hispanic 
White, other than Hispanic 
TOTAL 

5. Percent of student population from low income families: 

Definition of low income (check all that apply): 
School lunch program 
Aid to Families with Dependent Children 
(AFDC) 

Other 

6. Number of limited English proficient children enrolled: 

7. Number of children who are receiving instruction through this Title VII project: 
Limited English Proficient (LEP) 
Language Minority EP 
English Language Background EP 



! ' A 



7*Z 
/<*% 

100% 
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Date Section Completed: 



SECTION 3: STUDENT SELECTION INFORMATION 

Section 3 contains information regarding selection of Limited English Proficient (LEP) and English 
Proficient (EP) students for participation in this Title VII developmental program. 

Requirements: 

1 The Secretary reviews applications based, in part, on the extent to which the applicant has 
identified the needs of the LEP students to be served in the program, including the lack o 
proficiency of the LEP children in speaking, writing, and understanding the English language; 
and the degree of proficiency of the LEP children in their native language and in other courses 
or subjects of study [Reg. Sec. 501.31 (a)(1)(i)-(ii)]. 

2. Reliability and objectivity of the method used to identify needs of the LEP students to be served 
in the program [Reg. Sec. 501.31(a)(2)]. 

Directions for Worksheet 3.1 : LEP and EP Student Selection Procedures. Check the appropriate 
space(s) to indicate which assessment procedure(s) were used to determine selection into the Title VII 
developmental project for LEP and EP students. Only check selection criteria that are employed by 
your project. 

Worksheet 3.1 
LEP and EP Student Selection Procedures 

STUDENT 
CATEGORY 

Selection Procedures / Instruments LEP EP 



a. Home Language Survey — ^ — — — 

b. English language proficiency 

(1) Oral 

(2) Reading 

(3) Writing 

c. Native (non-English) language proficiency 

(1) Oral 

(2) Reading 

(3) Writing 

d. Academic Achievement in English in math, 

science or social studies 

e. Academic achievement in a non-English 
language in math, science or social 

studies 

f . Teacher recommendations — 2L_ — 7L 

g. Parent recommendation & — — & 

h. Other: 

1-5 
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Directions for Worksheet 4.3: Staff information Addendum. In this worksheet 
staff refers to staff, other than teachers, who spend less than 50 percent of 
their time with Title VII students. Please indicate number of other staff 
working with Title VII students. Leave blank if not applicable. 



Worksheet 4.3 
Staff Information Addendum 



Position 


Number 


School Psychologist 




Counselor ( Cjlk^^^C^ 


y 


Instructional Specialist 




Community Liaison 




Computer Technician 




. Materials Developer 




. Resource Teacher 




Other 












• 
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c«rtific»t« or •ndortt»«at for •»eh ftaff « n« 

»ultipX« e«rti£ic«t««/«ndor««»«nt« . 




WkUf with Titl. m .t«4.nt. r.*ardl.« of fnttaf tourc. 



0 
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S-7 



^ far fahl* 4 t: ictdtaie Fraparatioa. For aaeh eatagory of staff 

SoSa. Boc?oral $< or Profa.aioaal *gr„ 



TaUai* 4.8 



D«gr«« 

1. ligh School Diploma 

2. Aaaociata Dagraa 

3. lachalor's Dagraa 



4. Kastar'a Dagraa 

$. Doctoral or 

Profassioaal Dagraa 



idaiaiatratora 



Ttacbars 



3 



t 



FartproftMioatl 
Stftif 



Othtr 



6 



• *U ..t.tf -orkln, «tth Tttl. VII .tu«.»t. r^.rdl... of fundinj 
•ourco . 

- w-i- a «. stata or Local Certification o£ 
Direction, for TaMo < ^Vck S th« •WWritt. ap.c. if your 
^^"Ti^rict F oV otiof l.Sful author?!y provid.a bilingual or 
ESL cartificataa or aodoraasaata . 

iticn 
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Directions for Table 4.10: Staff Training. Enter number of staff in the Title VII project with the areas 
of training indicated. 

Table 4.10 
Staff* Training 



Training/Experience 

1. Instruction to be proficient 
in the native language of 
students 

2. Instruction to be proficient 
in English (non-Native 
English speakers only) 

3. Linguistics (e.g., Applied 
Linguistics, 
Sociolinguistics) 

4. Cross-Cultural 
Communication or 
Cultural Awareness 

5. Instructional Methodology 
or Curricula in Native 
Language of Students 

6. Instructional Methodology 
or Curricula in English 

7. Educational Assessment 

8. Education Research 
Design and Methods 
(including Program 
Evaluation) 

9. Other Training 
10* Peace Corps 
11. Travel 

12* Other Experience 



Administrators 



Teachers Paraprofessional Other 

3 / 



3 



2> 



* All staff working with Title VII students regardless of funding source. 
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auabar of staff at aaeh ability UmI. 

Tba iafomtie. r.quirad to co.pl.ta Tabla. 4.11-4.13 can b. found in tha St.fi 
Quastioaaaira. 

Training in CXi 



o£ Training 





Xuaba; 


ability to Usa Traiaiag ia Classrooas 


Typa of Traiaiag 


of 
Staff 


0 


1 




3 


Collaga Coursa«ork 












Xasanrica Workshops 


s 










Othar 













Training In aas 



1. Xastruetioa to ba proficiaat ia 
taa aatita laaguag a of studaats 

2. Xastruetioa to ba proficiaat ia 
taglisb (aoa-Katita taglisb 
spaakars oaly) 

3. liaguistics (a.g.. *W^** 4iM . 
liaguistics. Sociollagaistlcs ) 

4. cross-Cultural Coaauaicatioa 
or Cultur al Awaraaass 

5. laatructioaal Mataodjlogy or 
Curriemla U UMif Uaguaga 
of Sti 



Ruabar 

of 
Staff 



toy Araaa ©£ Training 
Ability to Usa Traiaiag ia Classrooas 



«. Xasti 
Curri< 



, "lathodology or 

•ia taglisb 



7. Muc atioaal Uaassatat 

S. tdueatioa lasaareh Oasiga aad 
Hatbods Uaeludiag Frograa 
Cvaluatioa) 

9. Otbar 



3 



/ 



0 
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3l« 1ft 



of traiaiag. 



T*tol« -4.X3 
©* TrauLnincr toy 



lr«a of Traiaiag 

1. Xaatructioa to ba profieiaat ia 
tba aati*a laaguaca of atudaata 

2. Xaatructioa to ba profieiaat ia 
taglisb (aoa-Hativa tagliab 
•poaxars oaly) 



laabar 

of 
Staff 



4 



3. Liaguiatiea <a.g.. appliad 
tiaguiatics, Soeioliaguiatiea) 



4. Croaa-Cultural Coaauaieatioa 
or Cultural awaraaaaa 

5. laatructioaal Kataodology or 
Curricula ia Mativa laaguaga 
of studaata 

(. laatructioaal Katbodology or 
Curricula ia togliaa 

7. tdueatioaal Xaaaaaaaat 

t. Mucatioa Raaaarcb »*aiga aad 
Motboda (iaeludiag Frograa 
Iraluatioa) 



If 



3 



at Training 
Typ« of Traiaiag 



Coux»oork 



Xattnriet 
forkfbop 



Othtr 
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6: Struud' 



stadias agggBi&jga Tibm 

omiT - — — worJchot 6.1. Stud.at 

action, for «!• €^ r^or^iS STSASSTC 
Proficioacy 0rad * * 4 . J thV aiS«r of Li»itod-Eacli«a- 

rref ielMt .tudoati SiTVcroM .caool. mcmiut to 
tb« total auabor o£ J^XS ' ehtfrado. 
co«pilo tho iaforaatioa for oae* *r»a. 




G r * d • 



Fro 



fictoncy 



Lisitod Eaoli»a 
Proficitat 




ta«li»a 
Proficioat 



Total 
Studoat* 



m 

Q 
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compile the information for each grade. 

MurBto^r- of T±tlI*VXX *TLi.«±l>l« 




Grade 



Limited English 
Proficient 




Ingliah 
Proficient 



Total 
Student* 



sssss its. sSSSiaa »v»^= 

Student.) «^*"*2 € ?Jil5r5SdSS end the total number of 

the number of English .chools as necessary to 

Nun»b« of -Titrl* J« 
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sssr r jaw warturss. - — 

-i column auabtrs 

giv« a p«rc«at. 



on 



lukir Of 
Struts 
evtuclT 
It ttojiet i 



j (I) 1 
(71 IttUitM I Mtor 
Uft j li I « 



1 



(III 

Sptcitl 
tucttiu 




111) 
i tutor 
j tutUri it 



I 



Ml 
j lukir 

iHrtieiutiM 

IU1 i H»tM«i4«7 j « Ulit 
«i£tH it i ttmti« I M «T« 



1141 

lukir 
•f lift 
*kimm 



11$) k \ 
1iul l 
lukir » 

•(•«!« ! 
Uroilu ; 



Ittt: 
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SO 



Section 7 s T«»* D*** 



f*.tf.nt. mf?riinl an litem 



, ^ i i Huab.r of Li»it.d Euali.h 

Direction, for T»bl«« 7 . 1 *nd 7. 2. w stud#nt , by Y.*r» in 
Srofici.nt «nd inglUh ^^J^^^rSSSt^ in th. Titl. 
Jroj.ct «d Gr.d.. «5 ^VtXt« who «p.nt on. y.yr 

VXI proj.ct. li»t th. nu»b.r "d.nt. who h«*. .P*nt two y..r. in 
£ th. proj.ct. th. «-^*J t ^£ th. total nu»b.r of 

th. proj.ct, .tc. In X* t aiC s S .cro.* school. .« n.c.«».ry to 
SSSTtS •in?orT. a t?:n 1 ror 1 ;.ch ar.d. 
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